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Abstract 

Baum-Katz theorem asserts that the Cesaro means of i.i.d. increments 
distributed hke X r-converge if and only if is integrable. We 

generahze this, and we unify other results, by proving that the follow- 
ing equivalence holds, if and only if G is moderate: the Cesaro means 
G-converge if and only if G{La) is integrable for every a if and only if 
\X\ G(\X\) is integrable. Here, La is the last time when the deviation 
of the Cesaro mean from its limit exceeds a, and G-convergence is the 
analogue of r-convergence. This solves a question about the asymptotic 
optimality of Wald's sequential tests. 
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1 Introduction 

In this paper, we prove a refinement of the strong law of large numbers and we 
apply it to a problem of sequential analysis. Let X and {Xn)n^i denote i.i.d. 
random variables defined on the same probability space, and 

Sn ■= Xi + • • ■ + Xn- 

The most standard version of the strong law of large numbers asserts that Sn/n 
converges almost surely if and only if X is integrable. This amounts to two 
statements: first, when X is integrable, the last time of a deviation of size 
at least a of Sn/n from x — E[X] is almost surely finite, for any a; and second, 
when X is not integrable, no value of x is such that is a.s. finite for any a. 
Strassen (1967) introduced refined versions of this, see also Lai (1976), using 
the notion of r-convergence, defined below. 
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Definition 1 (Strassen) Let r > and {Yn)n be random variables defined on 
the same probability space. Set 

LI := sup{0} U {n ^ 1 ; ||r„ - x\\ ^ a). 

The sequence {Yn)n is said to r-converge to x if and only if {L^Y is integrable, 
for every positive a. 

Complete convergence to x, see Hsu and Robbins (1947) and Erdos (1949), is 
the integrability of the total time spent outside of any ball around x. Since this 
time is at most L^, 1-convergence implies complete convergence. The following 
characterizes the r-convergence of Cesaro means of i.i.d. increments. 

Theorem (Baum and Katz (1965)) For each positive r, Sn/n r-converges 
if and only if iXl'""^^ is integrable. Then, Sn/n r-converges to E[X]. 

We generalize Baum-Katz theorem to every function G such that an analogue 
of the result can hold. We prove that these are exactly the moderate functions. 
This allows to solve an open question of sequential analysis. 

Definition 2 (Feller (1969)) A positive function G defined on t ^ 0, is mod- 
erate if G is non decreasing, increases to infinity, and if G{2t)/G{t) is bounded. 

Bingham, Goldie and Teugels (1989) call the moderate functions, "increasing 
functions of dominated variation" (see their section 2.1). For any deterministic 
non decreasing function G, increasing to infinity, {Yn)n G-converges to x if and 
only if G{L^) is integrable for every a. Here is our main result. 

Theorem A Let X and (X„)„^i denote i.i.d. random variables, defined on 
the same probability space, and let G denote a moderate function. Then, Sn/n 
G-converges if and only if \X\G(\X\) is integrable. More precisely, assume 
that X is integrable and centered. Then, assertions (a), (b) and (c) below are 
equivalent. 

(a) |X|G(|X|) is integrable. 

(b) For every a, S{X,G,a) :— J2n>i''^^^ ^i''^) -P[\^n/n\ ^ a] is finite. 

(c) For every a, G{L^) is integrable. 

Furthermore, if G is non decreasing, unbounded, and non moderate, assertions 
(a) and (c) are not equivalent. 

Theorem B Let G denote a moderate function. Under an integrability as- 
sumption analogous to assumption (a) in theorem^^ Wald's sequential test is 
asymptotically optimal, when the error probabilities goes to zero, with respect to 
the G-moment of the observation time of the test. 

See section|21for a precise statement of theorem|B] Baum and Katz (1965) prove 
theorem IXI for G{t) ~ V with r > 0, as a part of their theorem 3, and they prove 
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a similar statement for G{t) ~ V log(t) with r ^ 0, as a part of their theorem 2. 
All these functions G are moderate. Bamxi and Katz (1965) use results of 
Katz (1963). Some methods of these two papers are from Erdos (1949). We use 
some methods of these three papers but none of their results. 

Lanzinger (1998) studies a formally equivalent extension of Baum-Katz law. 
Basically, he shows that, in our theorem ^ (a) holds for G{t) = exp(6i) if 
and only if (b) holds for G{t) = exp(ct), and for a large enough (namely, for 
every a > c/b). Thus, Lanzinger's result applies to a law of large numbers if 
exp(c|X|) is integrable for every positive c. This condition is not equivalent to 
the integrability of i?(|X|), for any single function H. (To see this, note that, 
if is a candidate, then t = o{\ogH{t)) when t ^ oo. Choose f2 such that 
= o{H) and such that t = o{logil{t)). Then, ri(|X|) may be integrable while 
H{\X\) is not.) 

The paper is organized as follows. In section [51 we deal with the application 
of theorem IXI to sequential analysis. In section we reduce theorem^ to the 
case of symmetric laws, and we state explicit universal bounds of the quantities 
involved in assertions (a), (b) and (c) in terms of the quantities involved in 
assertions (c), (a) and (b) respectively, for symmetric laws. The proofs of these 
explicit bounds are rather cumbersome, and we only sketch them, in section^ 
This section also proves theorem 1X1 for non moderate functions. An appendix 
gives detailed proofs. 



2 Sequential analysis 

Theorem IBl answers a question of Koell (1995) about the asymptotic optimality 
of Wald's sequential tests. Koell proves that (c) implies (a) for a — 1/2 when 
stronger assumptions hold (his result is a version of proposition |31 below). The 
main result of Koell (1995) generalizes Lai (1981) and is as follows. 

Assume that the unknown law of the process {Yn)n is one of the finitely many 
distinct probability measures Pi, and call Hi the hypothesis 

H, [The law of (r„)„ isP,]. 

Denote by J^n the cr-field generated by {Yk)ke[i,n], choose a probability Q such 
that each Pi is absolutely continuous with respect to Q, and a probability P 
which is locally equivalent to each Pi. Call pin, resp. p„, the density of Pi, resp. 
P, with respect to Q, when restricted to The likelihood ratio of the sample 
(i^fe)i^fc^n under hypothesis is 

, ^ PniYi,...,Yn) 

p„(Yi,...,r„)- 

A decision rule is a couple (t, d) , where the observation time r is an integrable 
i^n)n stopping time and the decision d is a J^r random variable with values in 
{Hi}i. Given error probabilities a = {ai)i, a stopping time r belongs to the 
class T{a) if there exists a decision rule (r, d) such that Pi[d ^ Hi] ^ for 
every i. 
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Wald's sequential tests are commonly used decision rules, defined as follows. 
Fix a (multi)level c = (ci)i, and denote by Qi the rejecting time of Hi at level 
Ci, that is, 

Qi := inf{n ^ 1 ; ^ cj. 
Wald's sequential test at level c is defined by the relations 

Tc '■— minmaxgij, dc '■= Hk, k :— argmax g,-. 

i 

Theorem 2 of Koell (1995) proves the asymptotic optimality of {Tc,dc) with 
respect to i5[r'']. More precisely, assume that, for each ?, \ogR\^ r-converges 
under P. Then, for each (multi)probability of error a = {ai)i, there exists a level 
c = {ci)i such that {Tc,dc) belongs to T{a). Furthermore, c can be chosen such 
that Tc is asymptotically the smallest observation time in T(a) when a — > 0, in 
other words, 

E.,[t:] = M{E,y] ■ T e Tia)} ■ (1 + 0(1)), 

for all i, when a 0. Lai (1981) showed this for two laws Pi and P2- Koell 
also proves this, \it ^ f is replaced by an increasing function G in A, where A 
is a specific strict subset of the space of continuous moderate functions, defined 
in Kroell (1985). Our theorem implies that the same result is valid for any 
moderate function. 

As an example, assume that the function G is moderate, that the process (!"„)„ 
is i.i.d., and that 

log[pi (Fi ) Ml (Fi )] G(log[pi ( Yi ) /pa (Yi )] ) 

is integrable for every i. Then, {Tc,dc) is asymptotically optimal with respect 
to E[G{t)], that is, 

E,[G{tc)] = M{E,[G{t)] ; r G T{a)} ■ (1 + o(l)), 

for every i, when a 0. The preceding was an incentive to prove theorem fXl 

3 Effective bounds 

Theorem ^ is a consequence of propositions O to |H1 below. Propositions 13 to 
provide effective bounds of (a), (b) and (c) in terms of (c), (a) and (b) 
respectively, when the law of X is symmetric. PropositionElreduces the general 
case to the case of symmetric laws. We write La for L°. 

Proposition 3 Let G denote a moderate function with G{2t) ^ cG{t) for every 
positive t, and let X denote an integrable random variable. For a g]0, 1[, let t 
be such that E[\X\ ; \X\ ^ t] ^ (1 - a). Then, 

E[\X\ G{\X\)] 5=: {tG{t) + E[G{Ly2)]] ■ 
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Proposition 4 Letp ^ I be an integer, and let G denote a non decreasing func- 
tion such that G{t)/tP^^ is integrable on (1,+cxd) (call this the condition (1)). 
Let H he a non decreasing function such that, for any n ^ 1, 

^ nP ^G(fc)fc"(P+i). (2) 

Then, for any symmetric X , S{X^ G, 1) ^ Kp{X), where 

K,{X) := E[\X\ G{\X\)] + 2^^ {2p)\ E[l + \X\r' E[\X\ H{\X\)]. 

If G is moderate, (1) holds for p large enough and H = cG satisfies 0) for c 
large enough. 

Proposition 5 Let G denote a non decreasing function, and X denote a sym- 
metric random variable. Then, 

E[G{Li)] G(0) + 12 S{X, G, 1/8). 

Denote by X' an independent copy of X and call X* := X — X' a symmetrized 
version of X. 

Proposition 6 Let G be moderate. Each of the assertions (a), (b) and (c) of 
theorem^^ holds for X if and only if it holds for the symmetrized X* . 

From proposition O (c) implies (a) if G is moderate. From proposition^ (a) 
implies (b) if G is moderate and if the law of X is symmetric. To see that 
the series in (b) then converges for every a, note that, if (a) holds for X, then 
(a) holds for every X/a as well. From proposition |S1 (b) implies (c) if G is 
non decreasing and if the law of X is symmetric. To see that G{La) is then 
integrable for any a, note that Li for the sum of the random variables Xn/a is 
La for Sn- 



4 Sketches of proofs 

The proof of proposition louses precise estimates of 

P[sup \Xk/k\ ^ 1] 

through Poincare's formula for the probability of a union of sets, Abel's trans- 
formation for discrete sums, and the moderation of G. 

In proposition 13 Tn is the sum of n truncated variables 

A multinomial expansion allows to estimate i?[(T„)^P]. Since Xnk is symmetric, 
the terms with at least one odd power disappear. A bound of the remaining 
terms involves a decomposition along the first index i such that \Xin \ is maximal 
amongst {|Arfe„|}fc^„. Precise combinatorics then yield the result. 
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In proposition [SI one decomposes the sum along the intervals [2',2*+^[. From 
a maximal inequality for symmetric random variables, due to Levy, the events 
"max jS'nl/n is large for n in an interval" and "|S'„|/n is large for the last n in this 
interval" have the same probability, up to a factor of 2. One then reverses the 
time on each interval, uses Levy's inequality again, and another decomposition 
of a sum along the intervals [2*, 2^~^^[ concludes the proof. 

Proposition El follows from symmetrization techniques and estimations of the 
probability of a deviation from any median, as exposed in section 18.1 of Loeve 
(1977) for example. Furthermore, if {X'^)n is an independent copy of (X„)„, 
and if where X* := Xn — X'^, is a symmetrization of (X„)„, one can 

compare the events {La ^ n], {L'^ ^ n} and {L* ^ n}, for different values of 
a and n, where L'^ and L'^ are the fmictional La, when applied to X' and X* 
instead of X. 

The proof of theoremlXlfor non moderate functions is as follows. If (a) and (c) 
are equivalent, G{La) is integrable for every positive a as soon as \X\ G{\X\) is 
integrable. But L2a for (2Xrt)n is La for (X„)„, hence |X|G'(2|X|) should be 
integrable as soon as \X\ G{\X\) is. 

Thus, let G be a non decreasing, increasing to infinity, non moderate function. 
Then, G(2t„) ^ nG{tn) for an increasing sequence {tn)n- Let the law of X have 
as support the set {±t„ ; n ^ 1}, and give to t„ and — 1„ the same weight of 
c/ [n? tn G{tn)), for a given constant c. The sum of the weights converges, hence 
c can be chosen so as to get a probability measure. Then, G(|X|)] is finite 

and G(2|X|)] is infinite. Finally, (a) and (c) are not equivalent for X. 



Appendix: Detailed proofs 
5 Proof of proposition [3] 

Let Un '■= Sn/n. Since La is an a.s. finite nonnegative integer, 

E[G(La)] = G(0) + ^(G(n) - G{n - 1)) P[sup \Uk\ > a]. (3) 

Starting from an interval of length 2a, for example ] — a, +a[, one cannot make a 
jump whose length is larger than 2a and still be in this interval after the jump. 
Assume from now on that a ~ 1/2. The preceding remark gives: 

{sup \Uk\ 1^ 1/2} D {sup |Xfc/fc| ^ 1}. 

The idea of the proof is to estimate precisely P[£',i] as n cx). Denote by 

i^k i^k 

Since En is a union of independent events, Poincare's formula at the first and 
second orders gives 

Y,P[\Xk\^k] ll-J2PU^\>^]] s;P[-B„] ^P[|Xfc| ^fc], 

k'^n \ i>k / k^n 
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hence ct„ (1 — <Jii+i) ^ P[E„] ^ (t„. Since X is integrable, (t„+i ^ and 
P[En] (7n when n — » oo. More quantitatively, assume that n ^ nx — [tj, 
where t is defined in the statement of proposition |31 Then, n + 1 ^ t and 

an+i ^ E[\X\-n:\X\^n+l] 
E[\X\ ; \X\ t] ^ I ~ a. 

This yields a an ^ P[En] for n ^ nx- When n < nx, 

aan ^ P[En] + a {nx - n). 

Going back to the equation (O, a lower bound of E[G{Li/2)\ is 

S[G(Li/2)] > G(0) + 5](G(?i) - G(n - 1)) a K - [nx - n)+). 
An application of Abel's transformation to the right hand member gives: 

"x- l 

^G(n)P[|X| >n] ^ a-ii?[G(ii/2)]+ 5] G(n) (4) 

^ a-i£;[G(ii/2)] + (nx-l)G(nx-l) 
sc: a-^E[G{L,^2)] + {t-l)G{t). 

There should be a multiple of G(0) in the left hand side, but the coefficient of 
G(0) is 1 — a{ai — {nx ~ 1)), which is nonnegative because: 

o"! < nx + cTnx+i ^nx + l~ai^nx+ a^^ — 1. 
Decomposing the sum of Q along the intervals I{i) :~ [2',2'+^[, one gets: 

^ G{n) P[\X\ ^n\^Y.^^ G{T) P[\X\ ^ (5) 

n^l i^O 

On the other hand, 

E[\X\G{\X\)] ^ ^((n + l)G(n + l)-nG(n))P[|X|^n] 

G(l) + ^(2^+iG(2'-+i) - 2^G(2^)) P[\X\ ^ 2*]. 

The last sum runs over integers « ^ 0. We replace the term i = by its value 
and for any i ^ 1, we bound the coefficient of P[\X\ ^ 2^] by 2'+'^G{2'+^). This 
yields 

E[\X\G{\X\)] ^ 2G(2) + ^2'+iG(2^+i)P[|X| ^ 2*] 
^ 2G(2) + 4c2^2^G(2*)P[|X| ^ 2^+1], 

by an application of the moderation property of G between 2*+-'^ and 2'^~^. 
Composing this with the inequalities and (0), one gets the first assertion of 
proposition O up to an additional term in the right hand side. This extra term 
reads as 2 G(2) — 4c^ G{t), which is nonpositive and therefore may be omitted. 
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6 Proof of proposition HI 



In this section, the law of X is symmetric. For 1 ^ /c ^ n, set 

n 
fe=l 

If \Xk\ ^ n for all 1 ^ fc ^ n, then 5„ = Tn. Hence: 

P[\Sn\ >n]s^ nP[\X\ ^ n] + P[|r„| ^ n]. 

We write i^il^l ^ n] as a sum of P[k ^ \X\ < fc + 1] and we use the fact that 
G is non decreasing. This yields 

^n-^G{n)nP[\X\ ^ n] sC E[\X\G{\X\)]. 

For P[|T„| ^ n], we use the Markov inequality with an even integer 2p, whose 
value will be specified later: 

In the expansion of {Tn)'^P, all the terms with at least one odd power disappear 
because X is symmetric, hence 

Em.r^] = ^'^(2^, 2c) E[Xf:^ Xt ■ ■ ■ Xl'i^-l 

c 

where c = (ci)i^i^„ runs over all the nonnegative integer valued sequences 
of length n and of sum p, and where M(2p, 2c) is the multinomial coefficient 
associated to the sequence 2c. Recall that for any p ^ and any nonnegative 
integer valued sequence c = (ci)i<ji^„ of sum ci + C2 + ■ • ■ + c„ = p, one has 

M{p,c) ■■=-r^ 

C\\C2\ . . . c„! 

If ^ g ^ p, we write AI{p,q) :~ AI(jj,{q,p — q)) for the usual binomial 
coefficient. 

The value of the expectation E[Xl!^^ X2n ■ ■ ■ ^nn"] entirely determined by 
the sequence d = {di)i which is made by listing the non zero terms of c and by 
writing them in the same order. This value is: 

e{n, d) := E[Xl^^ ^ . . . - \Xo\ ^ n], (6) 

where we introduced 

\Xo\ :=max{|X,|; l^ i^q}. 

In equation ©, the sum of d is p, the length of d is q, and all the terms of d 
are non zero. Exactly M{n, q) sequences c give the same sequence d of length 
q. Since M{n,q) ^ 7i' (9!)^"'^, this yields 

E[iT„fP] ^ J2 2d) n« iq\)-' e(n, d), 

d 
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where q is the length of the sequence d. Summing up over n, one gets 
^ G{n) P[|T„| ^ n] ^ M{2p, 2d) (ql)-^ e{d), 

n^l d 

where e{d) is the sum 

e{d) := J2 ^(") ""^"^""^ e(n, d). 
We now bound each e{d). Summing up the equations © yields 
eid)=E fllX,]'"^- G{n)ni-^P-' 

■i=l n^\Xo\ 

Let p denote an integer such that the condition of proposition 0] holds. Since 
q ^ p for every d, one has 

J2 Gin)n^-'P-' ^iXol^-P ^ G{n) n-^P+'^ ^ IXo^^p H{\Xo\). 

n^\Xo\ n^\Xo\ 

Since ^ |Xop'^'^^ for every 1 ^ i < q, one has 

9 



e{d) < 



Write io for anyone of the integers such that \Xig\ = \Xq\, for example the 
smallest one. Then, the expectation of the right hand side, when restricted to 
the event {io =^ j}, is at most 



E 



Hi\X,\)\X,\l[\X,\;to=j 



^E[\X\r-^E[\X\H{\X\)] 



There are at most q possible values of «o and, for a fixed length q, there are 
M{p — l,gr — 1) possible values of the g-uplet d. (For completeness, we prove 
this last assertion in lemmaQat the end of this section.) For a given q, M{2p, 2d) 
is maximal when each di is as close as possible of p/q. For I ^ q ^ p, this upper 
bound is maximal for q = p. Hence, 

M{2p,2d) s; c{p) := i2p)\/2'P. 

This shows that proposition 0] holds with the bound £'[|X| G(|X|)] + Cp{X), 
where 

CpiX) := cip)J2M{p-l,q-l)qiql)-'E[\X\]^-'E[\X\Hi\X\)] 

q=l 

< c{p)E[l + \X\]P-^E[\X\H{\X\)]. 

The last assertions of proposition 01 about moderate functions are direct conse- 
quences of the inequality G{2t) ^ c G{t). The combinatorial lemma used during 
the proof is the following. 
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Lemma 7 For I ^ q ^ p, there are M{p — l,q — I) sequences d — (rfi)i^i^q, 
integer valued, of length q and sum p, such that di ^ 1 for every i. 

Proof of lemma [71 We count the integer valued sequences b = of 
sum (p — q) such that bi ^ for every 1 ^ i ^ q. The cardinal of this set is the 
coefficient of z^"^ in the expansion: 

q /+00 \ 

n E^" =(i-r^ 

i=l \n=0 I 

and this coefficient is M{p — 1, f? — 1). This ends the proof of lemma [3 

7 Proof of proposition O 

In this section, the law of X is symmetric. In Sectional ® provides E[G{Li)] 
as the sum of a series. The decomposition of this series along the intervals 
:= [2^2'+l[ yields 

E[GiLi)] ^ G(0)+^P[Li ^2'] ^ (G(n) - G(n - 1)) 

i^O ne/(i) 

s; G(0) P[Li = 0] + ^(G(2*+i - 1) - G(2* - 1)) P[Li ^ 2']. 

The probabilities written in the right hand side are bounded by 

P[Li ^ 2'] = P[sup \Un\ ^ 1] s; Vp[ max |C/„| ^ 1], 

where Un '■— Sn/n. Furthermore, 

{ max \U„ \ ^ 1} C Dj := { max |5„| ^ 2*} 
ne/(j) «e-fO') 

An interversion of the order of the summations on i and j yields 

E[G{Li)] ^ G(0) + G{2'+^) P[A]. (7) 

Since X is symmetric, zero is a median of every Sn and a maximal inequality 
due to Paul Levy, see Loeve (1977), section 18.1, states that 

P[max|5„| ^t] s;2P[|5™| ;? t] 

for any m ^ 1 and t ^ 0. This yields an upper bound of P[Di] as follows. First, 
Di can only occur if |S'2i+i | ^ 2Y2, or if is realized, where 

D'^ :={3ne/(z); \Sn - S^.^i] ^ T /2}. 

We now bound the probability PiD'j]. The process 

(5'2i + i — Sn)nel{i) 
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follows the law of the time reversal of (S'„)i^„^2m hence PiD'i] — P[D'/] with 
D'^ := {3n ^ 2\ ^ T/2}. 

Levy's inequality yields 

P[D''] < P\ max \Sn\ ^ 2^2] < 2P[|S',.+i| ^ 272]. 

Coming back to the event Di, we proved that 

<3F[|52,+i| ^272]. (8) 

This yields 

E[G{L,)] G(0)+^3G(2*+i)P[|;72.+i| 1/4] 

= G(0) + ^3G(2*)P[|t/2,| =J 1/4]. 

On the other hand, we have to estimate 

s ■.= J2n''Gin)P[\Un\ ^ 1/8]. 

A decomposition of s along the powers of 2 gives 

0^2-('+i)G(2^) J2 P[\Un\^l/8]. 

00 nG/(i) 

Recall that X is symmetric and let n belong to Since the law of Sk is 

symmetric, 

P[\S2A ^ 2*-2] <c p[max\Sj \ ^ T'^] 

^ 2P[|S'„| > 2*-2] ^ 2P[|S'„| > n/8]. 

Finally, 

4s^^G(2*)P[|[/2.| ^ 1/4]. (9) 
The inequalities l(7|), ^ and lO prove the assertion of proposition |5l 

8 Proof of proposition El 

We recall some basic facts about the symmetrization of a random variable 
around one of its medians. A median of a real random variable Y is any real 
number fJ-{Y) such that 

P[y s; /x(F)] ^ 1/2 and P[F ^ ^(Y)] ^ 1/2. 

Let Y' be an independent copy of Y, independent of all the other random 
variables. Then, the law of F* := F — F' is symmetric and 

p[\Y - fj,{Y)\ ^ 2t] 2P[|y*| ^ 2t] 4P[|y| ^ t] (lo) 
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for every t, see Loeve (1977), section 18.1. If H is non decreasing, equation UlUfl 
yields 

E[H{\Y-^iiY)\)]^2E[Hi\Y*\)]^AE[H{2\Y\)]. (11) 
In order to apply this to X„, we introduce 

n 
k=l 

which is a symmetrized version S* of 5„. Set U* := S*/n and let G be a 
moderate function. Then 

E[\X*\ G{\X*\)] ^ 4E[\X\ G{2\X\)] ^ 4ci?[|X| G(|X|)]. 

Hence, (i) for X implies (i) for X* . For the reverse implication, 1)11(1 yields 

E[\X - m\ Gi\X - m\)] ^ 2E[\X*\ G(|X*|)], 

where m := IJ.{X) is a median of X. The expectation of the left hand side 
is finite, when it is restricted to the set {|X — m| ^ m}, and, on this set, 
\X -m\^ \X\/2. Hence, 

E[\X\G{\X\/2); \X ~m\^ m] 

is finite. The complete expectation G(|X|/2)] is finite as well. 

Finally, G{t) < cG{t/2) for any t, hence (a) for X* imphes (a) for X. 

The equivalence of (b) for X and (b) for X* stems from the fact that, if /^(^n) 
is a median of ^„ and if f„ converges to zero in probability, then /i(^ra) converges 
to zero. (To see this, assume that ^„ converges to zero in probability. Then, 
for every positive a, PW^n\ ^ a] < ^ for n large enough. This means that 
lA'(?n)l ^ Oi for n large enough. Since a is arbitrary, /z(^„) converges to zero.) 

Since X is integrable and centered, C/„ converges almost surely to zero and 
n{Un) converges to zero. For a fixed positive a and for n large enough, 

P[\Un\ ^ a] ^ P[\Un - ti(Un)\ ^ a/2] 

sc: 2P[|C/:| ^a/2] ^4F[|C/„| 

where the convergence of /i(C/„) to zero yields the first inequality and (|10|) at 
the beginning of this section yields the two other inequalities. The equivalence 
for (b) holds. 

For (c), we start with the remark that 

{La ^n} = {3k ^ n, \Uk\ ^ a} = {sup \Uk\ ^ a). 

The first equality is the definition of La, the second equality is a consequence 
of the almost sure convergence of C/„ to zero. (Hence, the supremum is in fact 
almost surely a maximum.) Write L^, resp. L*, for the functional La associated 
to (X'j)„, resp. to (X*)„, rather than to (X„)„. We rely on the following 
inclusions: 

{L*2a ^n}c {La ^ n} U {L'a ^ n}, 
and {L2a ^n}r\ {L'^ sC n} C {L*^ ^ n}. 
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The first inclusion yields ^[^20 ^ "] ^ 2P[La ^ n], and 

E[GiL;j]^2E[GiLa)]. 

In the second inclusion, L2a and arc independent and L'^ is a.s. finite, hence 
P[L'^ ^ n] converges to 1 and P[L2a ^ n] is equivalent to ^ n] when 

n ^ (X. This proves that G{L2a) is integrable as soon as G{L*g) is. Finally, (c) 
for X* holds if and only if (c) for X does. This ends the proof of propositionEl 

9 The non moderate case 

The proof of theorem El for non moderate functions is as follows. If (a) and 
(c) are equivalent, G{La) is integrable for all positive a as soon as \X\ G{\X\) 
is integrable. But L^a for (2X„)„ is La for (X„)„, hence \X\ G'(2|X|) should be 
integrable as soon as \X\ G{\X\) is. 

Let G be a non decreasing, increasing to infinity, non moderate function. Then, 
G{2tn) ^ nG{tn) for an increasing sequence (tn)n- Let the law of X have 
as support the set {±i„ ; n ^ 1}, and give to i„ and — i„ the same weight of 
c/ (n^ tn G{tn)), for a given constant c. The sum of the weights converges, hence 
c can be chosen so as to get a probability measure. Then, G(|X|)] is finite 

and G(2|X|)] is infinite. Thus, (a) and (c) are not equivalent for X. 

The following properties of moderate functions are direct consequences of the 
definition and we state them without proof. 

Power and logarithmic functions are moderate, exponential functions are not. 
The function G{t) — i** log(i)'^ loglog(t)'' . . . is moderate if the first non zero 
exponent is positive. If G(t) ^ af^ when t — > 00, with c nonnegative, then G 
is moderate. If G is moderate, then G{t) ^ cf^, for c large enough and t ^ 1. 
There exists non moderate G, such that G(t) ^ f^, for any positive c. There 
exists non moderate G, which are differentiable and such that G'{t) ^ f^, for any 
positive c. For any moderate G, there exists a smooth moderate H and c J5 1, 
such that H ^ G ^ cH. One can choose H such that H{t + 1)/H{t) ^ 
l + a/(t+l), for a large enough. Finally, there exists moderate G, such that 
the limit set of log G(t)/ log(i) as t — > 00 is the interval [0, c], for any positive c. 
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